A solvable model of quantum random optimization problems 
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We study the quantum version of a simplified model of optimization problems, where quantum 
fluctuations are introduced by a transverse field acting on the qubits. We find a complex low-energy 
spectrum of the quantum Hamiltonian, characterized by an abrupt condensation transition and a 
continuum of level crossings as a function of the transverse field. We expect this complex structure 
to have deep consequences on the behavior of quantum algorithms attempting to find solutions to 
these problems. 
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A large part of theoretical research in quantum com- 
puting has been devoted to the development of algo- 
rithms that could use quantum properties to perform 
computational tasks faster than classical devices. A typ- 
ical problem that is encountered in almost all branches of 
science is that of optimizing irregularly shaped cost func- 
tions Hp: two standard examples are fc-SAT, Hp count- 
ing the number of unsatisfied constraints on k boolean 
variables, and the coloring of a graph with q colors (q- 
COL), Hp then being the number of monochromatic 
edges. The decision version (whether a solution, i.e. a 
configuration with Hp = 0, exists) of both problems 
belongs to the class of NP-complete problems. One is 
mostly interested in the scaling of the difficulty of these 
problems when the number N of variables involved be- 
comes large. Besides the formal computational complex- 
ity theory which classifies the difficulty of problems ac- 
cording to a worst-case criterion, their typical case com- 
plexity is often studied through random ensemble of in- 
stances, for instance assuming a flat distribution over the 
choice of M — aN constraints on N variables. 

Statistical mechanics tools have provided a very de- 
tailed and intricate picture of the configuration space of 
such typical problem Hamiltonians Hp [1]. A key con- 
cept that emerged in this context is that of clustering of 
solutions. The topology of the space of solutions changes 
abruptly upon increasing the density of constraints a in 
the following way: i) at a first threshold ad it goes from 
a single connected cluster to a set of essentially disjoint 
clusters; ii) the number of clusters itself undergoes a tran- 
sition at a c > ay from a phase where it is exponential 
in N, thus defining an entropy of clusters (the complex- 
ity), to a phase where the vast majority of solutions are 
contained in a finite number of clusters; Hi) finally, the 
total entropy of solutions vanishes at a s > a c where the 
problem does not admit a solution anymore (the ground 
state energy becomes positive). This sequence of tran- 
sitions (sketched in Fig. 1) has a deep impact on the 
performances of most classical optimization algorithms, 
that slow down dramatically deep in the clustered phase. 

To solve the optimization problem Hp with a quan- 
tum computer, one can choose its Hamiltonian to be 



H = Hp + THq, where Hq does not commute with 
Hp and induces quantum fluctuations. One can switch 
off Hq adiabatically in order to find the ground state 
of Hp [2]. The question that arises naturally is: what 
are the consequences of the complicated structure of Hp 
for the spectrum of HI Indeed, we expect the spectrum 
to be strongly influenced by the clustering phenomenon, 
and that this should have consequences on the perfor- 
mances of quantum algorithms as it does in the classical 
case. The influence of Hp should be the strongest, and 
the easiest to analyze, for small T. 

Some initial steps in this analysis have been recently 
performed in [3]. It was shown that increasing Y can 
induce level crossings between classical ground states 
and classical low-energy excited states: in the thermo- 
dynamic limit these level crossings can be accompanied 
by exponentially small (in system size) gaps in the spec- 
trum of H that might be particularly dangerous for a 
class of quantum algorithms such as the Quantum Adi- 
abatic Algorithm (QAA) [2]. However, the Hp studied 
in [3] admit a single ground state (see [4] for a recent dis- 
cussion of this point), and therefore they do not show the 
complex clustering phenomenon explained above, whose 
influence on the spectrum of the quantum problems re- 
mains unclear. 

In this paper, we address this issue by studying the 
quantum version of a simplified model of random opti- 
mization problems introduced in [5], that shares part of 
the structure with more complex problems, at the same 
time being fully solvable in the thermodynamic limit. 

We find, for this model, that quantum fluctuations 
have a strong influence on the cluster structure: they lift 
the degeneracy inside each cluster and the ground state 
energy is lowered proportionally to the entropy of the 
cluster. This mechanism is somehow similar to the order- 
by-disorder phenomenon that is found in some frustrated 
magnets [6]. Therefore, if the classical energy changes 
from cluster to cluster, then level crossings are induced 
between clusters by varying Y. These crossings happen 
over a continuous range of Y, giving rise to a complex 
spin glass phase characterized by a continuously chang- 
ing ground state (as in classical spin glasses upon chang- 
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FIG. 1: Pictorial representation of the different phase tran- 
sitions in the set of solutions of the Random Subcubes 
model [5]. 

ing the temperature or the coupling constants [7]) and 
an exponentially small gap. Finally, at large T the spin 
glass phase undergoes a first order "delocalization" tran- 
sition towards a simple quantum paramagnetic phase, of 
the type discussed in [8-10]. This set of results gives 
us a consistent picture of the effect of adding quantum 
fluctuations on top of the complex classical phase space 
sketched in Fig. 1, and allows to study in the same toy 
model the interplay between the different phenomena dis- 
cussed in [3] and [8-10]. 

Model. — The quantum version of the Random Sub- 
cubes model [5] is defined as follows. We take the Hilbert 
space T-L of iV spins 1/2 (qubits), in the basis of the Pauli 
matrices erf, \g_) = \a\, ■ ■ ■ , cat). A cluster A is a subset 
(subcube) of the Hilbert space A = {\a} | Vi, cr^ £ nf}, 
where are independent (set- valued) random variables 
which encode the authorized values of irf = { — 1} 
or {1} with probability p/2, and {—1, 1} with probabil- 
ity I — p. The variable i is "frozen" in A in the former 
case and "free" in the latter. Note that the number of 
states in a cluster A is equal to 2 Nst - A \ where Ns(A) 
is the number of free variables; we call s(A) the inter- 
nal entropy of a cluster. We next define a set S as the 
union of 2 N ( 1 ~ C * > random clusters. We define a Hamil- 
tonian Ha = Neo(A)^ a( - A for each cluster, and 

a "penalty" Hamiltonian H v = NVJ2<r<ts \s){s.\- Tne 
problem Hamiltonian Hp ~ Hv + J2a is then diag- 
onal in the basis \a). We wish to interpret the states in 
S as "local minima" of Hp and the others as "excited 
states". A sharp distinction between them can be ob- 
tained by sending the positive constant V to infinity; for 
finite V, we will always assume that V ^> max,4eo(A). 
As a quantum term we choose here THq — — T X^j=i °f> 
i.e. a transverse field acting on the spins. Note that tak- 
ing instead an Hq proportional to J2a a' \z)(s.'\ wom d 
lead to the simpler multi-solution Grover problem inves- 
tigated in [11]. 

Analysis of the classical Hamiltonian. — In [5] it is 
shown that the set S has the following structure, i) For 
a < ad — log 2 (2 — p), each state \a) belongs to an ex- 
ponential number of clusters and the space S coincides 
with %. ii) For a > ad, one has S ^ %. The number of 
clusters J\f(s) of entropy s is given by 



E(s)=iV- 1 log 2 7v'(s) = l 



D(s\\l-p), (1) 



where D(x\\y) — x\og 2 (x/y) + (1 — x) log 2 [(l — x)/(l — 
y)]. This expression is restricted to the interval s £ 



[smin,s ma x] for which E(s) > 0. Note that this depen- 
dency of the complexity S(s) on the internal entropy is 
present in &-SAT and g-COL but not in XORSAT whose 
quantum version was studied in [10]. Above ad there is 
"ergodicity breaking" in the sense that a local random 
walk over solutions starting in one cluster takes an ex- 
ponentially long (in A) time to reach another cluster [5] . 



Hi) For a > a s 



1 + log 2 (l - p 2 /2)/2, the clusters 



are well separated, in the sense that with probability 1 
for A — > oo the Hamming distance (number of opposed 
spins) between any two clusters is of order A. From now 
on we focus on the region a > a scp , which is of principal 
interest for our purposes. Most results are expected to 
hold more generically for a > a d (because the effect of 
overlapping clusters is negligible [5]), yet the arguments 
used below should be refined in this regime 

One can compute the total number of states in <S by 
observing that 



151 =2 



N.i 



=£2 



Ns(A) 



ds2 N ^ 



(2) 



therefore Stot = m ax sg [ Smin Smax ] [S(s) + s]. It turns out 
that for ad < a < a c = p/(2 — p) + log 2 (2 — p), the 
maximum is at s*(a) £ [s m ; n ,s max ]. Therefore most of 
the configurations of S belong to one of the exponentially 
many (in N) clusters of size s* . For a > a c , the max- 
imum is in s* = s max , therefore most of S is supported 
by the largest clusters whose number is sub-exponential 
in N since E(s max ) = 0. The order parameter for this 
condensation transition is the average Hamming distance 
between two random configurations in <S, close to A/2 for 
a < a c and strictly smaller otherwise. Finally, for a > 1 
there are no more clusters and the set <S is empty. 

Spectrum of the cluster Hamiltonian. — We will now 
study the spectrum of the quantum Hamiltonian H = 
Hp + THq as a function of T, and we consider first the 
( "hard" ) V — » oo limit where Hp is infinite for the states 
that do not belong to S: then we can project out these 
states from the Hilbert space and look to the restriction 
of H = J2a Ha+THq on S, which contains 2 Nstot states. 
Since the matrix Hq only connects configurations at unit 
Hamming distance, and different clusters have distance 
of order A, the Hamiltonian H has no matrix elements 
connecting different clusters. Therefore we can diagonal- 
ize H separately in each cluster. The restriction of H 
to a given cluster A with Ns(A) free spins is equal to 
Ha plus the Hamiltonian of Ns (A) uncoupled spins in a 
transverse field, its spectrum is hence made of levels 



E k (A) = Ne (A) + (2k - Ns(A))T 



(3) 



with k = 0,-- - ,Ns(A), each ( ^ ') times degener- 
ate. In particular the lowest level has energy per spin 
ecs^) = eo(A) — Ts(A), therefore the energy of clusters 
with larger entropy decreases faster with T. 
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Quantum paramagnetic state. — Next, we consider a 
"soft" version of the model in which V is finite (still with 
V 3> maxA eo(A)). Therefore now H is defined on the 
full Hilbert space H. In this case, in addition to the 2 Nstot 
energy levels discussed above (that we shall refer to as the 
S-band), there exists another set of 2 N - 2 Nstot ~ 2 N 
levels (the V-b&nd), whose energy is expected to be of 
order V at small T. For the states in the 5-band we 
use perturbation theory in T; the leading order is of the 
form of Eq. (3), and at any finite order n the correction 
is 0((r 2 / (NV)) n ), so it vanishes in the thermodynamic 
limit. Moreover, an argument based on small rank per- 
turbation analysis [12] shows that the spectrum of the 
F-band states is close to the one of N free spins in trans- 
verse field with classical energy NV: 



El 



NV + (2k-N)T, fc = 0, ■ 



,N 



(4) 



with degeneracy close but not equal to (, ). In partic- 
ular the lowest of such levels is the Quantum Param- 
agnetic (QP) state \QP) ~ 2~ N / 2 J2 a |£>, which is uni- 
formly extended in the basis \a) and has energy per spin 
eQP = V — T. 

Level crossings. — We discuss now the zero temper- 
ature phase diagram of the model for a > a SG p and 
TV — > oo. To get a meaningful thermodynamic limit, the 
number of clusters of energy eo is set to 2 JVS ( e °), where 
E(eo) is some increasing function of e € [0, e m ] (as in 
most random optimization problems). We assume that 
E(e m ) = 1 — ct so the total number of clusters in S is 
still 2 N ( x ~ a \ Since the frozen variables are chosen inde- 
pendently for each cluster, the complexity of clusters of 
energy eo and entropy s is £(eo, s) = S(eo) — Z?(s| 1 1 —p). 
It vanishes for a given value s max (eo) which is also an in- 
creasing function of eo- The 5-band, or Spin Glass (SG), 
ground state energy is 



e SG = mm 

e o e[0,e n 



mm 

i(eo),»n 



(e - Ts) 



= min [e - rs max (e )l 

e o e[0,e m ] 



(5) 



The minimum is in eo = as long as T < T\ c = 
l/(sj nax (0)). Above this value, the minimum is in a dif- 
ferent eo for each value of T: in this region the ground 
state changes abruptly from one cluster to another upon 
changing T by an infinitesimal amount [7], see the inset 
of Fig. 2. Since the clusters have Hamming distance pro- 
portional to N, we expect these crossings to be avoided at 
finite iV producing exponentially (in N) small gaps [3, 9]. 
Note that in some relevant cases the slope of S(eo) in 
eo = is infinite, therefore T\ c = and level crossings 
happen at all T. 

The energy eQp crosses esc given by Eq. (5), giving rise 
to a first order phase transition between the spin glass 
and the quantum paramagnet [8-10] at a critical T ocV, 
see Fig. 2. As a consequence, the transverse magnetiza- 
tion m x = ole/olT has a jump at the transition [10]. 




FIG. 2: Low energy spectrum of the model for a scp < a < a s . 
As an example we choose (following [5]) p = 0.7, a = 0.85, 
and E(e ) = (1 - a)[2 + e /e m - (e /e m ) ln(e /e m )]/3 for e £ 
[0, e m ] with e m = 0.1. Main panel: Energy of the SG (cluster) 
ground state [Eq. (5), full line] and of the QP state eQp = V — 
r for V = 1 (dashed line). A first order transition between the 
two states happens at Y ~ 2. Inset: Level crossings in the SG 
state. For better readability we plot esG + Fs max (0) [Eq. (5), 
full line] and show the energy eo — r[s max (eo) — s max (0)] of 
two different clusters with eo = 0.05, 0.2 (dot-dashed lines). 

The condensation transition. — The previous analy- 
sis shows that in the region a scp < a < a c the pertur- 
bation THq has a dramatic effect. At T = 0, most of 
the states in S belong to one of exponentially many (in 
N) small clusters, while at any T > the few largest 
clusters of entropy s max have the smallest energy. A 
more complete picture is obtained by studying the model 
at finite temperature. It is convenient to separate the 
contribution of the two phases to the partition function, 
Z = Tre-P H = Z SG + Z QP , with c = 2 cosher): 



Z, 



QP 



J2e- 0E * =e-P NV c N 



(6) 



Z SG - Y. e ^ EkiA) = I ae ds2 N *Me-e Ne °c Ns . 

A,k J 

The free energy is / = -{T/N)\nZ = min{/ SG , / QP }, 
with /qp = V — T In c and 



/sg = 



—T max 

eS[0,e m 

SG[Smin(e),S,r 



[E(e ,s)ln2 - /3e 
.(e)] 



; In ( 



(7) 



The first order transition happens when the free energies 
cross, while the condensation transition a c (T, 0) happens 
when the maximum in Eq. (7) is attained in s max for the 
first time; these lines are plotted in Fig. 3. We observe 
that in the limit 3 — > oo, the lines a c (r,/3) shrink to 
the horizontal axis and the system is in the condensed 
phase for any T > 0. The first order transition to the 
QP phase happens for larger values of T and is almost 
independent of 3 at low temperature (for > 1). 



4 





1 i 1 
QP 








SG 



















a 

FIG. 3: Phase diagram of the model for p — 0.7, E(eo) as in 
Fig. 2, and ft = 1 (full lines). The vertical line corresponds 
to «sc P = 0.797 for this value of p. The higher F line is the 
first order transition between SG and QP. Above the lower 
F line a c (F,/3 = 1) the system is in the condensed phase. 
The condensation transition lines a c (T,/3) are also reported 
(dashed lines) for different values of /3, showing that the non- 
condensed phase disappears for j3 — > oo. The complexity of 
the zero-energy clusters is E(eo = 0) = 2(1 — a)/3, hence one 
has a c (r = Q,p = ao)= + §log 2 (2-p) = 0.875. 

Conclusions. — In this paper we introduced the quan- 
tum version of a simple toy model of optimization prob- 
lems [5]. In the classical case T = 0, the model captures 
the essential structure of the space of solution of random 
optimization problems, and displays several phase tran- 
sitions that are present also in more realistic problems 
such as fc-SAT and g-COL, at least at large q, k. We ex- 
plored the consequences of this complex structure on the 
spectrum of the quantum Hamiltonian at T > 0, and we 
showed that: i) Quantum fluctuations lower the energy of 
a cluster proportionally to its size, ii) As clusters have an 
energy distribution, level crossing between different clus- 
ters are induced as a function of T in the spin glass phase, 
due to a competition between energetic and entropic ef- 
fects. These crossings happen in a continuous range of T, 
giving rise to a complex spin glass phase characterized by 
a continuously changing ground state. Since the clusters 
are separated by an extensive Hamming distance, as were 
individual solutions considered in [3], we expect an ex- 
ponentially (in system size) small gap everywhere in this 
phase. Hi) At large T ~ V the spin glass phase undergoes 
a first order transition towards a quantum paramagnetic 
phase [8-10], corresponding to the complete delocaliza- 
tion of the ground state in the computational basis \a). 
iv) At finite temperature, there is a line of condensation 
transitions a c (T,/3) that shrinks to V = at low tem- 
peratures: indeed, at zero temperature the condensation 
transition becomes abrupt. While at T = the space 
of solutions is dominated by an exponential number of 
clusters of intermediate size, for any T > the biggest 
clusters contain the ground states. 



Overall, this toy model shows that the low energy spec- 
trum of quantum optimization problems can be very com- 
plex, and characterized by different level crossings: inter- 
nal level crossings in the spin glass phase, or the crossing 
between the spin glass and the quantum paramagnet giv- 
ing rise to a first order phase transition. Moreover, both 
entropic and energetic effects are important. We expect 
that this complex structure of the low-energy spectrum 
of the quantum Hamiltonian will have deep consequences 
on the behavior of quantum algorithms: for instance, the 
Quantum Adiabatic Algorithm proposed in [2] should run 
into difficulties because of the exponentially small gaps 
that are expected at the crossings. 

We expect these results to be also relevant for the 
physics of quantum glasses: indeed, mean-field lattice 
glass models fall in the same class of random optimiza- 
tion problems. In this context the glass transition cor- 
responds to the condensation transition discussed above. 
The phase diagram we reported in Fig. 3, characterized 
by a re-entrance of the glass transition line, has been 
found using different approaches [13]. Extending these 
results to more realistic optimization problems, and fur- 
ther investigating the connection between the spectrum 
and the performances of quantum algorithms, are two 
lines of research that should be developed in the future. 

We wish to thank B. Altshuler, G. Biroli, F. Krzakala, 
R. Monasson, D. Reichman, J. Roland, G. Santoro and 
L. Zdeborova for important discussions. 
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